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ABSTRACT 

The objective of this study was to design and validate a measur¬ 
ing instrument to evaluate the performance of university profes¬ 
sors. The Evaluation of Teaching Performance (CEID [Centro de 
Estudios e Investigaciones Docentes (Center for Teaching Stud¬ 
ies and Research)]) questionnaire was administered to 1297 
university students. Various factor analyses were performed 
(exploratory and confirmatory), of the internal consistency, de¬ 
scriptive statistics, and correlation of all of the items. The data 
obtained confirmed a suitable psychometric structure for the CEID 
scale, which was made up of three dimensions (planning, devel¬ 
opment, and result). It is therefore concluded that it is a valid and 
reliable instrument for evaluating the performance of a university 
professor. 

KEYWORDS: TEACHING EVALUATION, MEASURING 

INSTRUMENT, ESTIMATION, UNIVERSITY TEACHING, 
TEACHING COMPETENCE. 

1 INTRODUCTION 

Currently, as a result of the adaptation of studies to the European 
Higher Edueation Area (EHEA), university edueation requires a 
series of important modifieations to what has been done until 
now. This adaptation requires universities to improve the quality 
of their aetivities by means of systematie evaluation 
meehanisms, both internal and external, with one of the pillars of 
this adaptation being support for the seientifie-teehnieal 
innovation and development proeesses, whieh involves a series 
of organizational and pedagogieal ehanges that eould eneourage 
interest in innovative pedagogieal methods (Marques, 2008). In 
this proeess of the methodologieal renovation of universities, the 
assessment of the students eould be the determining faetor in 
finding out and aeting on the edueational quality of the 
professors, for whieh it would be neeessary to design measuring 
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instruments in whieh the dynamie of the teaehing-leaming 
proeess is evaluated in terms of methodology and teaehing 
eompeteneies. 

One of the most signifieant ehanges in the new model is the 
formulation of new qualifieations based on professional 
eompeteneies (Carreras, 2005). This foeus on eompeteneies 
overrides the traditional university preparation system based 
exelusively on subjeet matters or diseiplines. Preparation based 
on professional eompeteneies aims to provide learning with 
signifieanee and funetionality, and to put into aetion a set of 
knowledge, attitudes, skills, and values in the development of 
professional aetivity, involving the student in an aetive manner, 
and thereby eneouraging refleetion and eritieal thinking, 
allowing the student to make deeisions, solve problems, design 
projeets, ete. That is, the use of self-regulated styles that 
eneourage autonomy would faeilitate the integration of the 
knowledge that the student aequires (Eeary, Walker, Shelton, & 
Harrison, 2013), leading the student to show greater interest in 
and eommitment to the subjeet matter he or she is studying, and 
to improve his or her aeademie performanee (Vansteenkiste, 
Soenens, Sierens, Euyekx, & Tens, 2009). This new model 
involves a signifieant ehange in the way the teaehing-leaming 
proeess is eoneeived at universities, in whieh the professor must 
not only design and present the eontents to be developed. It is a 
matter of providing ineentive for teaeher involvement and 
developing the eritieal knowledge of the students, to whieh end 
they must speeify the teaehing methodologies and evaluation 
systems to be developed for eaeh subjeet matter in relation to the 
previously established professional eompeteneies, thereby 
faeilitating their transition to the professional environment 
(Salmeron, 2013). Aeeording to this preparation model based on 
eompeteneies, the evaluation systems and teaehing methods are 
stmetured and designed aeeording to the eompeteneies to be 
aequired, and so working in the new university model will mean 
greater demands on the part of the faeulty (Pallisera, Fullana, 
Planas, & del Valle, 2010). Ineorporating the dynamies of 
internal evaluation into the management of qualifieations will 
therefore espeeially require a high level of motivation in the 
faeulty. In this sense, the evaluation of teaehing aetivity appears 
to aequire a signifieant value within the new systems. 
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guaranteeing the quality of university institutions. And we ean 
therefore understand these evaluation proeesses as a means of 
refleetion to implement polieies to aet on and improve the 
quality of teaehing performanee. In this mission, in order to 
aehieve an improvement in quality in the manner affirmed by the 
European Assoeiation for Quality Assuranee in Higher 
Edueation (ENQA), university institutions must develop and 
make available formal meehanisms sueh as approval, periodie 
review, and monitoring of their eurrieula and degrees, using 
eontrol systems sueh as objeetive evaluation. 

There is some preeedent in Spain for evaluating the quality in 
university edueation, sueh as the Programa de Evaluacidn de la 
Calidad Docente [Teaehing Quality Evaluation Program] 
(1980), the Programa Experimental de Evaluation de la Calidad 
del Sistema Universitario [Experimental Program for the 
Evaluation of the Quality of the University System] 
(1993,1994), and starting in 1996 universities have evaluated the 
quality of their qualifieations through programs sueh as the Plan 
Nacional de Evaluation de la Calidad de las Universidades 
[National Plan for the Evaluation of the Quality of Universities], 
the II Plan de Calidad de las Universidades [University Quality 
Plan II], the Programa de Evaluation Institucional de ANECA^ 
[ANECA Institutional Evaluation Program] (2007), or by means 
of other similar independent programs (ACSUG^^, AVAP^^^ or 
AQU^Q. In the past 15 years, universities have begun an 
evaluation of their serviees foeusing on quality management. On 
21 Deeember 2006 the Ministry of Edueation and Seienee 
(MEC) published the Directrices para la elaboracidn de titulos 
universitarios de grado y master [Direetives for the preparation 
of university degrees and master’s degrees], whieh ineluded the 
need to introduee a Quality Guarantee System as one of the 
essential elements in terms of proposing degrees in the future. 
Until reeently, university institutions used an evaluation system 
based mainly on researeh aetivity, leaving the professor’s 
edueational duties in the baekground. That is, the professor was 
evaluated foeusing mainly on the total number of publieations he 
or she produeed, the impaet faetor of where the publieation was 
pieked up, and the number of times a speeifie artiele was eited. 
Moreover, teaehing evaluation was foeused solely on assessing 
the aequisition of knowledge or laek thereof on the part of the 
students in terms of higher or lower aeademie performanee 
(Buendia, 1996). And the students are the ones who have most 
eommonly been ehosen to evaluate the quality of teaehing 
performanee. In this regard, Tejedor (1996) points out that the 
referenee eriterion of the students should not be the only one, 
sinee there are a number of eontributions to be made in relation 
to the agents evaluating the professor, with the main ones being 
the students, other professors, and the professor him or herself 
(Gareia and Congosto, 2000). In this manner, teaehing 
evaluation has evolved in sueh a way that it is eurrently 
eonsidered to be an extremely important aspeet of analyzing the 
preparatory and professional quality of edueational institutions. 
This new perspeetive establishes evaluation models based on 
self-evaluation as a reflexive and partieipatory proeess, with the 
intention of involving all members of the system in order to 
provide higher quality. 

In terms of the instruments used to evaluate teaehing 
performanee, a eertain disparity has been observed among 
Spanish universities, although they do have eertain aspeets in 
eommon. A series of studies were earried out in an attempt to 
analyze the instruments used at eaeh Spanish university. For 
example, Munoz, Rios de Deus, and Abalde (2002) reviewed the 
instruments and dimensions used at the different universities. 


and they designed a new instrument eontaining 40 items grouped 
into 10 dimensions (eomplianee with obligations, infrastrueture, 
eurrieulum, knowledge-interweaving of the subjeet matter, 
methodology, materials, attitude of the professor, evaluation, 
labs, and satisfaetion). Along these same lines, Lopez-Barajas, 
and Carraseosa (2005) ereated a questionnaire made up of 25 
items broken down into four dimensions: interaetion with the 
students, methodology, teaehing obligations and evaluation, 
means, and resourees, for teaehing evaluation at the Universidad 
de Jaen [University of Jaen]. Using the student eriterion, they 
determined whieh dimensions were most valued and whieh ones 
best predieted the teaehing assessment, with the “interaetion 
with the students” dimension being the one that most often 
predieted the overall assessment of the professor. Also, Casero 
(2008) ereated an instrument made up of 92 items grouped into 
infrastrueture, eurrieulum knowledge/interweaving of the subjeet 
matter, methodology, materials, attitude of the professor, 
evaluation, labs, and satisfaetion, in order to evaluate university 
professors, seeking a eonsensus among students and professors 
regarding the importanee they plaeed on eaeh of the items, with 
the goal of ereating the ideal instrument for teaehing evaluation. 
Gonzalez and Lopez (2010) attempted to analyze whieh teaehing 
eompeteneies Spanish universities eonsider essential in defining 
the role of the faeulty, and to thereby establish a system of 
teaehing quality evaluation indieators, ereating a pilot evaluation 
instrument made up of 40 items grouped into the following 
dimensions: design of the eurrieula/teaehing guides for the 
eourse, teaehing methodology, praetieal aetivities, didaetie 
resourees, teaeher planning, evaluation systems, eomplianee 
with teaehing obligations, and the attitude of the faeulty, where, 
as opposed to the Casero study (2008), the ereation of the faeulty 
eompeteney profile was obtained by means of an expert 
assessment proeess and not by eonsensus among the faeulty and 
students. 

Various professors from the Universidad Politeeniea and 
Autonoma de Madrid [Polyteehnie and Autonomous University 
of Madrid] earried out a study in 2010, in whieh they attempted 
to develop a system of university teaehing quality evaluation 
indieators based on the analysis of the questionnaires used at 
different Spanish universities. Although the dimensions 
proposed by the different universities fluetuate between 2 and 9, 
the majority of them group the items aeeording to the three 
dimensions of the model proposed by ANECA (planning, 
development and result), to whieh are added other dimensions 
sueh as teaehing environment or satisfaetion. The Universidad 
de Navarra [University of Navarra] uses a similar questionnaire 
made up of 24 items grouped into four dimensions (planning, 
development, results and satisfaetion global). Similarly, 
Gonzalez and Lopez (2010) earried out a study in whieh they 
attempted to estimate the level of validity of the MIECEEES'' 
Model, as well as the degree of importanee the students plaeed 
on eaeh of the items, in order to aehieve a quality university. In 
the end, the instrument was made up of six dimensions, 19 
indieators, and 85 items that put into operation the indieators for 
the quality evaluation model in the European Higher Edueation 
Area. 

Pozo, Bretones, Martos, and Alonso, (2011) earried out a 
review, by autonomous eommunity, of Spanish universities that 
use the DOCENTIA model to evaluate the aetivity of their 
university professors, in whieh they explain the adaptation of 
this “Doeentia-Almeria by Pozo, Gimenez, and Bretones” model 
(2009), with the goal of ereating a eommon framework for the 
evaluation of the faeulty at Andalusian universities, establishing 
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a fourth dimension entitled “innovation and improvement” as the 
main differenee from the ANECA proposal, in whieh they 
inelude elements related to the proeesses of ehange ineorporated 
by the professor that may eontribute to improved teaehing 
quality. 

Although many universities use the same model, there is 
apparently a great deal of diversity in terms of establishing 
whieh faetors are representative of a quality teaehing 
methodology at universities. Thus, taking all aspeets into 
eonsideration, the study objeetive was to design and validate a 
measuring instrument allowing for the evaluation of university 
teaehing performanee, and to this end we hope to provide 
validity and reliability to an instrument made up of three 
dimensions: planning, development and result. 

2 METHOD 

2.1 Participants 

The sample eonsisted of 1,297 to 4^^-year university students 
(762 men and 535 women) aged 18 to 27 (M= 24.75; SD = 5.09. 
The original sample was divided into two subsamples. 
Subsample number 1 eonsisted of 649 students (410 men and 
239 women) and was used to earry out the exploratory faetor 
analysis. Subsample number 2 eonsisted of 648 students (411 
men and 237 women) and was used in the eonfirmatory faetor 
analysis. 

2.2 Measurements 

Teaching evaluation. The final version of the Evaluation of 
Teaching Performance questionnaire (CEID) eonsisted of 28 
items whieh were grouped into three faetors: planning, with four 
items (e.g. “He/she provides elear information about objeetives, 
bibliography, tutorials, eontents and assessment methods in the 
subjeefs eurrieulum”), development, with 17 items (e.g. “He/she 
promotes teamwork”) and result, with seven items (e.g. “He/she 
applies the assessment eriteria of the aetivities as established in 
the subjeefs eurrieulum”). The items were assessed using a 
Eikert seale with a seoring range between 1 {Completely 
disagree) and 5 {Completely agree), beginning with the sentenee 
“The professor...”. 

2.3 Proceeding 

The questionnaire was developed based on an extensive review 
of the literature that provided the most important aspeets to be 
evaluated, whieh were later refleeted in the different items. The 
drafting of those items emerged from the fieldwork of different 
university professors who are experts in the subjeet matter. A 
first version with 68 items was drafted, whieh was redueed to 40 
items after being reviewed by the experts, and grouped into three 
faetors: planning, development, and result. In addition, the seale 
was subjeeted to a general eomprehension test, in whieh the 
students were asked to read the items earefully and to assess 
how important they were to them. 

The department heads and eourse eoordinators were eontaeted 
and informed of the researeh objeetive. The questionnaires were 
eompleted in the elassrooms and before lessons in the presenee 
of the main researeher, while the professor being assessed was 
not in the elassroom. Eaeh eourse and eaeh professor were 
assigned an identifieation number. The main researeher 
informed the students of the researeh objeetive and instrueted 
them on how to properly eomplete the questionnaire. He/she also 
resolved any doubts that the students had, and the whole proeess 


required approximately 10 minutes. Partieipation was voluntary 
and the partieipants’ anonymity was preserved. 

2.4 Data analysis 

In order to determine and evaluate the instrument’s faetor 
strueture, an exploratory faetor analysis and a eonfirmatory 
faetor analysis were earried out, respeetively. The instrument's 
internal eonsisteney was also analyzed using Cronbaeh's alpha 
eoeffieient, and the deseriptive statisties (averages and standard 
deviations) and bivariate eorrelations of all items were obtained. 
The SPSS 21.0 and AMOS 21.0 statistieal paekages were used 
for the data analysis. 

3 RESULTS 

3.1 Exploratory factor analysis 

After several exploratory faetor analyses, eertain items were 
eliminated due to not reaehing a minimum rotation of .40. 
Finally, a faetor analysis was earried out for main eomponents 
with direet oblimin rotation with subsample 1, the results of 
whieh were 28 items grouped into three faetors: planning (made 
up of four items: 4, 20, 21 and 22), development (made up of 17 
items: 1, 2, 3, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, 18, 19, 23 and 
26), and result (made up of seven items: 5, 6, 14, 24, 25, 27 and 
28). The eigenvalues obtained were greater than 1.00 (1.67, 
1.50, and 1.34, respeetively), explaining a total variation of 
68.2% (38.09%, 15.36% and 14.77%, respeetively) (Table 1). 


Table 1. Evaluation of Teaching Performance questionnaire (CEID) 


Items 

Factor 

1 

Factor 

2 

Factor 

3 

1. Presents the minimum content of 
his/her subject matter, tailored to the 
students’ knowledge 


.728 


2. He/She is easily accessible (tutori¬ 
als, e-mails, etc.) 

- 

.733 

- 

3. He/She allows the student to organ¬ 
ize and distribute part of the assign¬ 
ments to be performed in the course 


.736 


4. He/she provides clear information 
about objectives, bibliography, tutori¬ 
als, contents, and assessment methods 
in the subjeefs curriculum 

.603 



5. He/She informs the students of the 
competencies they will be expected to 
acquire 



.569 

6. He/She provides me with scientific 
information that allows me to gain a 
better and deeper understanding of the 
subject matter 



.694 

7. He/She presents the contents follow¬ 
ing a clear and logical framework, 
highlighting the important aspects 


.605 


8. He/She allows and encourages 
student participation 

- 

-.757 

- 

9. He/She promotes individual work 

- 

-.828 

- 

10. He/she promotes teamwork 

- 

-.834 

- 

11. He/She relates the teachings to the 
professional environment 

- 

-.577 

- 

12. He/She provides initial and final 
overviews of the session and/or subject 
in class 


-.632 


13. He/She encourages student interest 
and the motivation to learn 

- 

-.614 

- 


14. He/She fosters research and a - - .530 

critical spirit in students 
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Table 1 (continued) 


15. He/She facilitates student-student 
and student-professor interaetion 

- 

-.712 

- 

16. He/She attends and responds 
elearly to questions asked in elass 

- 

.719 

- 

17. He/She adequately attends to the 
tutorials requested of him/her 

- 

.737 

- 

18. He/She maintains an objeetive and 
respeetful position with the students 

- 

.577 

- 

19. He/She organizes aetivities for the 
student to aetively partieipate in eourse 
assignments 


-.653 


20. He/She designs and relates the 
elassroom eontent to the lab eontent 

.649 

- 

- 

21. He/She effieiently ineorporates and 
employs ICTs (Information and Com- 
munieation Teehnologies) 

.498 



22. He/She has a good eommand of the 
eontents of the eourse 

.692 

- 

- 

23. He/She interweaves the eontent of 
the subjeet matter with other eourses 

- 

.598 


24. He/She applies the established 
eurrieulum with a eertain amount of 
flexibility for a better elass dynamie 



.625 

25. He/She uses material resourees that 
faeilitate learning 

- 

- 

.602 

26. He/She internets satisfaetorily with 
the students 

- 

-.609 

- 

27. He/She designs the eontent and 
develops the eourse to promote the 
aequisition of professional eompeten- 
eies 



.591 

28. He/she applies the assessment 
eriteria of the aetivities as established 
in the subjeef s eurrieulum 



.468 

Explained variation for eaeh faetor 

38.09% 

15.36% 

14.77% 

Total explained variation 

68.20% 




3.2 Confirmatory factor analysis 


A confirmatory factor analysis (CFA) was carried out with 
subsample 2, based on 28 observed measurements and on the 
three freely correlating latent constructs (Anderson and Gerbing, 
1988). The model was reduced in order to maintain reasonable 
degrees of freedom (Cecchini, Gonzalez, & Montero, 2007; 
Ntoumanis, 2001). Thus, the items that made up each of the 
dimensions were divided into three groups (Marsh, Richards, 
Johnson, Roche, & Tremayne, 1994). The validity of the 
measuring model was considered using a series of fit 
coefficients, also called goodness of fit measures: 

RMSEA, and the incremental indices (CFI, NFI and TLI). The 
maximum likelihood estimation method was used along with the 
bootstrapping procedure, since the result of Mardia’s 
multivariate coefficient was 61.56, which indicated a lack of 
multivariate normality of the data. For this reason, following the 
example of Finney and DiStefano (2006), the robust maximum 
likelihood estimation method was used (Byrne, 2001). After an 
initial analysis, the overall results of the model indicated a 
moderate fit (x^(59, N= 649) = 1899.01,;? = .000; = 5.47; 

CFI = .80; NFI = .11 \ TLI = .81; RSMR = .05; RMSEA = .08). 
With the goal of improving the fit, we proceeded to carry out an 
analysis of the Lagrange test (LMtest), which showed that the fit 
was increased if the errors (9 interactions) of certain items 
belonging to a single factor, and whose significance level was p 
< .000, were correlated. All items belonging to the development 
factor. The indices obtained were adequate: (69, N = 649) = 
1051.03,;? = .000; x^/d.f = 3.12; CFI = .91; NFI = .90; TLI = 
.90; RSMR = .06; RMSEA = .06. 


3.3 Analysis of internal consistency 

The internal consistency of each of the factors resulting from the 
factor analysis (Cronbach’s alpha) presented the following 
results: .70 for planning, .91 for development, and .79 for result. 
Considering all of the items in a single factor, the consistency 
obtained was .94. 

3.4 Descriptive analysis and bivariate correlations 

The average values for the planning, development, and result 
factors were, 3.95, 3.77, and 3.74, respectively. The correlation 
analysis data revealed that the three factors were positively 
correlated (Table 2). 

Table 2. Descriptive Statistics and Correlations of the questionnaire’s 
four factors 


Variables 

M 

SD 

1 2 

3 

1. Planning 

3.95 

.64 

y2** 

.73** 

2. Development 

3.77 

.57 

- 

82** 

3. Result 

3.74 

.58 

- 

- 


Note: **/> < .001; M = Mean; SD = Standard deviation. 


4 DISCUSSION 

According to Arranz (2007), society is increasingly demanding 
that universities operate under criteria of efficacy, efficiency and 
excellency. So the purpose of this study was to design and 
validate a measuring instrument that allows us to evaluate 
university teaching performance. In this sense, it seems 
important to have processes for evaluating performance 
methodologies that respond to the educational and professional 
needs implemented by the EHEA. Thus, in order for these 
evaluation processes to succeed, it may be essential to prepare 
the university professor in terms of techniques and procedures 
for said professor to participate more actively in the evaluation 
systems. The design and validation of measuring instruments 
may be a key tool in attempting to optimize teaching 
performance and thereby carry out an objective assessment of 
the results (Garcia and Congosto, 2000). The Evaluation of 
Teaching Performance questionnaire was designed for this 
purpose, and the suggestions contributed by the experts and the 
respective confirmatory factor analyses showed an instrument 
made up of 28 items grouped into three factors with adequate 
internal consistency (planning, development, and result), where 
teacher planning refers to everything related to the previous 
process of reflection and design of subject matter (the 
curriculum, the organization of courses, labs, tutorials, planning 
of anticipated learning activities, evaluation criteria and 
methods, teaching materials and resources). The development of 
the course involves everything related to the execution of and 
compliance with the curriculum, the teaching and learning 
activities carried out, anticipated pedagogical activities, as well 
as applied evaluation procedures. And the results, in terms of 
educational objectives, refer to the achievements made by the 
students, and to the aspects involving the revision and 
improvement of teaching activity, external recognition of 
teaching duties, and creation of teaching materials. Although we 
found much diversity in terms of determining which are the 
main factors to evaluate in teaching practice, the majority of 
Spanish universities use the model proposed by ANECA as a 
reference (Pozo, Bretones, Martos, & Alonso, 2011). Along 
these lines, Pozo et al. (2009) adapt this model for the 
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Comunidad de Andalucia [Community of Andalusia], grouping 
the dimensions into planning, development, results, and 
innovation and improvement. Other universities opt for 
proposing a higher number of more speeifie dimensions, sueh as 
the design of the eurrieulum, teaehing methodology, praetieal 
aetivities, didaetie resourees, evaluation systems, and attitude of 
the faeulty (Gonzalez-Lopez, & Lopez-Camara, 2010). They 
also group the dimensions into eriteria of interaetion with the 
students, methodology, teaehing obligations and evaluation, 
means, and resourees (Lopez-Barajas and Carraseosa, 2005). 
Casero (2008), in order to evaluate teaehing performanee, 
divides the faetors into infrastrueture, eurrieulum, 
knowledge/interweaving of the subjeet matter, methodology, 
materials, attitude of the professor, evaluation, labs, and student 
satisfaetion. Whereas Gonzalez and Lopez (2010) group them 
into eompeteneies, university information, role of the university 
student, orientation and tutoring systems, methodology, and 
student satisfaetion. Lukas, Karlos, Etxeberria, and Lizasoain 
(2014) propose an instrument for evaluating teaehing 
performanee made up of 4 dimensions: Teaeher planning (5 
items), Teaehing development and teaehing performanee (11 
items). Result (2 items), and two additional open-ended items 
(positive aspeets of the professor and aspeets to improve). 
Meanwhile, authors sueh as Bol-Arreba, Saiz-Manzanares, and 
Perez-Mateos (2013) opt for adapting the Student Evaluation of 
Edueational Quality (SEEQ) questionnaire, short version 
(Marsh, 1987). The newly ereated version is made up of ten 
items (Student interest in the eourse, use of teaehing materials, 
faeulty interest in the eourse, the aeeessibility of the professor 
during tutorials and outside the elassroom, usefulness of the 
teaehing materials, eontinuing evaluation tests and their 
usefulness, the suitability of the evaluation proeedures, the 
quality and explanation of the teaehing materials, the professor’s 
motivation for student partieipation in elass, and eourse 
workload). 

The teaehing evaluation earried out by the students 
(“Students’ evaluations of teaehing” SET) is used in the majority 
of universities worldwide as a measurement of teaehing quality, 
so that the results of the assessments provide the professor with 
feedbaek for improving his/her teaehing (Balam & Shannon, 
2010). Aeeording to the Kuzmanovie, Savie, Gusavae, Makajie- 
Nikolie, & Panie study (2013), the indieators of good teaehing 
and quality aeeording to the students are: the availability of the 
professor, his/her elarity of presentation, the methodologieal and 
systematie approaeh, the information given to the students 
regarding the eoursework, eneouraging aetive partieipation in 
elass, as well as eonsidering and responding to the students’ 
questions. Similarly, Shukrie (2011) determines that the most 
effeetive professors are the ones that know their students’ needs 
and try to inerease their motivation, use different teaehing 
strategies, possess good eommunieation skills, and eneourage 
the students to be optimistie about their abilities. 

Universities worldwide have developed eomplex proeedures 
and instruments for evaluating and guaranteeing quality in 
higher edueation based on the opinions of their students. This is 
why we find numerous instruments sueh as the “Students’ 
Evaluation of Teaehing Effeetiveness Rating Seale” (Toland, & 
De Ayala, 2005), the “Teaehing Profieieney Item Pool” (Barnes 
et ah, 2008), the questionnaire for student evaluation of teaehing 
(SET 37, Mortelmans, & Spooren, 2009), the Exemplary 
Teaeher Course Questionnaire (Kember, & Leung, 2008), or the 
“Teaehing Behavior Cheeklist” (Keeley, Furr, & Buskist, 2010). 


And although there is a eertain variety among them in terms of 
dimensions or items to evaluate teaehing, in general the 
dimensions identified are similar. Those involving organization, 
evaluation, and the professor-student relationship seem 
espeeially to be the most eommon in the majority of the 
instruments. For example, Dodeen (2013) uses a questionnaire 
with 29 items grouped into five dimensions: Knowledge and 
organization of the professor (7 items). Clear explanation (6 
items). Rating and evaluation (6 items), Teaehing methods (4 
items), and the Relationship with students (6 items). Toland and 
Alyala (2005) identify three dimensions: Delivery of eourse 
information, professor-student interaetion, and the regulation of 
the students’ learning. For Gursoy and Umbreit (2005) there are 
four dimensions: learning, organization, instruetion, and 
workload. 

Although these questionnaires present the validity and 
reliability neeessary for evaluating teaehing effeetiveness 
(Khong, 2014; Onwuegbuzie, Daniels, & Collins, 2009), the 
revision study earried out by Spooren, Broekx and Mortelmans 
(2013) warns that there are still eertain eontroversies in this 
regard in the literature, given that the majority of the teaehing 
evaluation questionnaires have not presented suffieient proof of 
validity. 

In the Spanish eontext, in spite of the diversity of taxonomies 
regarding the dimensions to evaluate, all of them present various 
elements in eommon and have also proven to be valid and 
reliable instruments for evaluating teaehing performanee, 
although an instrument being adequate is a neeessary, but not 
suffieient, eondition to guarantee a sueeessful evaluation 
(Muniz, & Bartram, 2007). 

With the design of this seale it may be possible to have an 
instrument that allows us to evaluate the teaehing performanee 
of university faeulty, in sueh a way that the results obtained in 
the evaluation may be of great use to the professor, providing 
objeetive data. It is therefore essential to eonsider the aspeets 
related to the proeess of applying the instrument, sueh as how 
the results of said instrument will be used, and it is important 
that the involved parties reeeive feedbaek following the 
evaluation (Hattie, 2009; Leung, Jiang, & Busserb, 2013; Muniz, 
& Fonseea-Pedrero, 2008) and that it be understood as a strategy 
to improve teaehing, involving the students, thereby guiding the 
teaehing aetivity (Padilla, & Gil, 2008), and that as a result there 
be implemented a series of plans for improvements and ehanges 
to their pedagogieal praetiee, that redefine the teaehing-leaming 
proeess being used up to the present (Lopez Ruiz, 2011), and 
that they optimize university edueational quality, thus providing 
a more preparatory evaluation (Moore, Walsh, & Risquez, 
2012). But all of this requires a ehange of attitude, refleeted in a 
transformation of teaehing styles (Gargallo, 2008). All of these 
pedagogieal ehanges involve a great demand on both the 
professors (Pallisera et ah, 2010) and students involved in the 
proeess. 

5 CONCLUSIONS 

After earrying out the different analyses, we have estimated a 
measuring instrument with adequate psyehometrie properties 
that give it validity for the assessment of university teaehing 
performanee. The three dimensions evaluated (planning, 
development, and result) show good internal eonsisteney (.70, 
.91, .79, respeetively), whieh guarantees the instrument’s 
reliability. However, this study does present eertain limitations 
in terms of the overall eharaeter of the evaluation proeess, whieh 
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in this case focuses exclusively on the students’ assessment, and 
although this assessment is necessary, it is not sufficient (Berk, 
2013). Other studies are therefore necessary to verify the 
instrument’s factor structure, carrying out an all-encompassing 
evaluation (Benton, & Cashin’s, 2012; Berk, 2009; 2014; Xu, 
2012) in which, apart from the student criterion, other 
assessments are considered, such as faculty self-evaluations, 
reports from persons outside the institution, work colleagues 
(Simona, Felicia, & Georgiana, 2014), etc., thereby achieving a 
more comprehensive teaching evaluation, since this type of 
evaluation offers valuable information from different 
perspectives, allowing us to triangulate the information and 
reorient the professor with the aim of implementing plans for 
improvement. 

Longitudinal studies may also be considered to analyze the 
validity of this scale’s content and construct, expanding the 
sample of students, and estimating structural regression models 
corroborating the results obtained. 
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